Imaging apparatus and methods for generating a guide display showing a photographing technique for approximating a composition of a subject image to that of a sample image

ABSTRACT

A display apparatus (which may be included in an imaging apparatus) includes: a display unit; a guide display generation circuit which acquires an image file including image data and photographing posture data including information of an inclination and a height of an imaging apparatus performing an imaging operation when the image data was created by the imaging operation to generate a photographing posture guide display based on the photographing posture data; and a display control circuit which causes the display unit to display an image based on the image data and the photographing posture guide display. A data processing apparatus may include a signal processing circuit which creates an image file including image data and photographing posture data.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation application of U.S. patentapplication Ser. No. 14/312,710 (referred to as “the '710 application”and incorporated herein by reference), filed on Jun. 24, 2014, titled“IMAGING APPARATUS AND METHODS FOR GENERATING A GUIDE DISPLAY SHOWING APHOTOGRAPHING TECHNIQUE FOR APPROXIMATING A COMPOSITION OF A SUBJECTIMAGE TO THAT OF A SAMPLE IMAGE” and listing Atsushi MARUYAMA, KazuhikoSHIMURA, Takashi KOBIKI, and Osamu NONAKA, as the inventors, the '710application being a Continuation Application of PCT Application No.PCT/JP2013/057297, filed on Mar. 14, 2013 and based upon and claimingthe benefit of priority from prior Japanese Patent Application No.2012-133096, filed on Jun. 12, 2012, the entire contents of all of whichare incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an imaging apparatus.

2. Description of the Related Art

A digital camera that presents advice for taking a well-composed picturehas been known. For example, Jpn. Pat. Appln. KOKAI Publication No.2011-135527 discloses a technology concerning a digital camera thatpresents a preferred composition in accordance with a scene that a userattempts to capture. For example, this digital camera has a compositionevaluation unit and a composition presenting unit. The compositionevaluation unit evaluates a composition of a sample image, and thecomposition presenting unit superimposes a composition highly evaluatedby the composition evaluation unit on a live view display and presentsit. For example, a position of a person or a position of a mountain issuperimposed on a live view display and presented in a display unit.

BRIEF SUMMARY OF THE INVENTION

According to an aspect of the invention, a data processing apparatus(which may be included in an imaging apparatus) includes: an imageacquisition circuit which acquires image data obtained by an imagingoperation of an imaging apparatus; a photographing state determinationcircuit which acquires photographing posture data including informationof an inclination and a height of the imaging apparatus at the time ofthe imaging operation; and a signal processing circuit which creates animage file including the image data and the photographing posture data.

According to another aspect of the invention, a display apparatus (whichmay be included in an imaging apparatus) includes: a display unit; aguide display generation circuit which acquires an image file includingimage data and photographing posture data including information of aninclination and a height of an imaging apparatus performing an imagingoperation when the image data was created by the imaging operation togenerate a photographing posture guide display based on thephotographing posture data; and a display control circuit which causesthe display unit to display an image based on the image data and thephotographing posture guide display.

According to yet another aspect of the invention, a file creating methodincludes: acquiring image data obtained by an imaging operation of animaging apparatus; acquiring photographing posture data includinginformation of an inclination and a height of the imaging apparatus atthe time of the imaging operation; and creating an image file includingthe image data and the photographing posture data.

Advantages of the invention will be set forth in the description whichfollows, and in part will be obvious from the description, or may belearned by practice of the invention. The advantages of the inventionmay be realized and obtained by means of the instrumentalities andcombinations particularly pointed out hereinafter.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate embodiments of the invention, andtogether with the general description given above and the detaileddescription of the embodiments given below, serve to explain theprinciples of the invention.

FIG. 1A is a block diagram showing a configuration example of a digitalcamera according to a first embodiment;

FIG. 1B shows an example of an exterior of the digital camera accordingto the first embodiment;

FIG. 1C shows an example of an exterior of the digital camera accordingto the first embodiment;

FIG. 2A is a view showing an outline of an example of an operation ofthe digital camera according to the first embodiment;

FIG. 2B is a view showing an outline of the example of the operation ofthe digital camera according to the first embodiment;

FIG. 2C is a view showing an outline of the example of the operation ofthe digital camera according to the first embodiment;

FIG. 2D is a view showing an outline of the example of the operation ofthe digital camera according to the first embodiment;

FIG. 3A is a flowchart showing an example of processing in the digitalcamera according to the first embodiment;

FIG. 3B is a flowchart showing the example of the processing in thedigital camera according to the first embodiment;

FIG. 4 is a flowchart showing an example of theme determinationprocessing in the digital camera according to the first embodiment;

FIG. 5 is a flowchart showing an example of guide display processing inthe digital camera according to the first embodiment;

FIG. 6A is a view showing an example of guide display in the digitalcamera according to the first embodiment;

FIG. 6B is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6C is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6D is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6E is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6F is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6G is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6H is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 6I is a view showing an example of the guide display in the digitalcamera according to the first embodiment;

FIG. 7 is a view for explaining an example of a relationship between anoutput from an atmospheric pressure sensor and a position of the camerarelative to a photographer according to the first embodiment;

FIG. 8A is a view for explaining an example of posture informationaccording to the first embodiment;

FIG. 8B is a view for explaining an example of the posture informationaccording to the first embodiment;

FIG. 9 is a view for explaining an example of a configuration of imagefile according to the first embodiment;

FIG. 10 is a view for explaining an example of a flow of data accordingto the first embodiment;

FIG. 11 is a view showing an outline of an example of a totalizationresult of popularity voting for images according to the firstembodiment;

FIG. 12 is a flowchart showing an example of processing executed by aserver according to the first embodiment;

FIG. 13 is a view for explaining estimation of a photographing methodbased on images according to a second embodiment;

FIG. 14A is a view for explaining the estimation of the photographingmethod based on images according to the second embodiment;

FIG. 14B is a view for explaining the estimation of the photographingmethod based on images according to the second embodiment; and

FIG. 15 is a view for explaining an example of a guide display accordingto the second embodiment.

DETAILED DESCRIPTION OF THE INVENTION First Embodiment

A first embodiment according to the present invention will now bedescribed hereinafter with reference to the drawings. FIG. 1A shows anoutline of a configuration example of a digital camera 10 according tothis embodiment. Further, FIG. 1B and FIG. 1C show an example of anoutline of an exterior of the digital camera 10. The digital camera 10comprises a signal processing control unit 1, an imaging unit 2, aposition sensor 3, a recording unit 4, a transmission/reception unit 5,an operation unit 6, a touch panel 7, a display unit 8, an accelerationsensor 9 a, a geomagnetic sensor 9 b, and an atmospheric pressure sensor9 c. The signal processing control unit 1 controls operations ofrespective units in the digital camera 10. Furthermore, the signalprocessing control unit 1 executes various kinds of arithmeticoperations as will be described later.

The imaging unit 2 includes, e.g., a lens 2 b, an imaging element, aprocessing circuit, and others. In the imaging unit 2, a subject imagethat has entered through the lens 2 b is converted into an electricalsignal by the imaging element, whereby an image signal is generated. Theposition sensor 3 is, e.g., a GPS unit and acquires a position of thedigital camera 10. The recording unit 4 includes, e.g., a removablestorage medium. The recording unit 4 records images acquired by thedigital camera 10 or data concerning these images. Moreover, therecording unit 4 records sample images obtained through, e.g., theInternet or data concerning these sample images. Additionally, imagesand others may be recorded in the recording unit 4 in advance.

The transmission/reception unit 5 includes a wireless device configuredto perform data communication with a server 50. The operation unit 6includes a switch and receives inputs provided by various operationsperformed by a user. The operation unit 6 includes a release button 6 afor still picture photographing that is arranged at a position where anoperation using, e.g., an index finger of a right hand is enabled. Whena user operates this release button 6 a, the digital camera 10 canperform a photographing operation. Further, the operation unit 6includes a switch, a dial, and other parts via which changes inphotographing parameters, e.g., a shutter speed, an aperture, exposurecorrection, a sensitivity setting, a focal position, and the like areinput.

The display unit 8 configured to display images includes, e.g., a liquidcrystal display panel. The display unit 8 is provided on, e.g., a backside of the digital camera 10. The touch panel 7 is provided on thedisplay unit 8. The touch panel 7 also receives input of instructionsfrom a user. The user can operate the digital camera 10 by, e.g.,touching a position corresponding to an icon displayed in the displayunit 8.

The acceleration sensor 9 a is a general triaxial acceleration sensor.The acceleration sensor 9 a detects the gravity and outputs a signalindicative of an inclination of the digital camera 10. Furthermore, theacceleration sensor 9 a can detect, e.g., a change in moving speed ofthe digital camera 10. The geomagnetic sensor 9 b is a generalgeomagnetic sensor and outputs a signal indicative of a direction thatthe digital camera 10 faces. The atmospheric pressure sensor 9 c is ageneral atmospheric pressure sensor and outputs a signal indicative of achange in height. The atmospheric pressure sensor 9 c can detect achange in height with a resolution higher than approximately 3 cm.

The signal processing control unit 1 includes a signal processing unit 1a, a sample acquisition unit 1 b, a theme determination unit 1 d, afeature extraction unit 1 e, a guide display generation unit 1 f, aphotographing state determination unit 1 h, a distance determinationunit 1 i, a display control unit 1 j, and a clock 1 k. The signalprocessing unit 1 a performs image processing and calculates a parameterfor control such as control of the respective units other than thefollowing various kinds of arithmetic operations or controls. Moreover,the signal processing unit 1 a controls operations of the respectiveunits in the digital camera 10. For example, the signal processing unit1 a combines image data obtained by an imaging operation, datarepresenting a later-described photographing posture, and any other datato create an image file.

The sample acquisition unit 1 b acquires a sample image. The sampleacquisition unit 1 b acquires, e.g., the sample image recorded in theserver 50 with the use of the transmission/reception unit 5 through theInternet. The sample acquisition unit 1 b has a retrieval unit 1 c. Theretrieval unit 1 c retrieves, e.g., an image of interest from manyimages recorded in the server 50. Additionally, the sample acquisitionunit 1 b may acquire a sample image from, e.g., the recording unit 4.The theme determination unit 1 d determines a theme of an image acquiredby the imaging unit 2. The retrieval unit 1 c retrieves a sample imagein accordance with, e.g., a theme obtained by the theme determinationunit 1 d.

The feature extraction unit 1 e extracts image features, e.g., a color,composition, a profile, and so on of an image acquired by the imagingunit 2. Further, the feature extraction unit 1 e detects, e.g., a facein an image. The feature extraction unit 1 e can determine a position ofa face in an image and can also determine, e.g., how the face isinclined with respect to the front. The above-described image featuresare recorded as image feature data 4 a in the recording unit 4. It is tobe noted that the image feature data does not necessarily have to berecorded in the recording unit 4, and it may be recorded in, e.g., theserver 50 connected through the Internet. Furthermore, the image featuredata may be sequentially acquired from the server 50. It is to be notedthat a sample image or its feature data may be recorded in the digitalcamera 10 in advance.

The guide display generation unit 1 f generates a guide display showinga photographing method by utilizing a sample image acquired by thesample acquisition unit 1 b. The guide display generation unit 1 fincludes a feature comparison unit 1 g. The feature comparison unit 1 gcompares the features extracted by the feature extraction unit 1 e withthe image feature data recorded in the recording unit 4 or the imagefeature data acquired from the server 50 through thetransmission/reception unit 5. The guide display generation unit 1 fcreates a view showing, e.g., a posture of a photographer at the time ofphotographing or how to hold the camera. Furthermore, the guide displaygeneration unit 1 f also creates an image showing a difference between,e.g., an image obtained by the imaging unit 2 and a sample image.Moreover, the guide display generation unit 1 f creates characterinformation or sound information representing a posture of aphotographer, how to hold the camera, or a difference from a sampleimage.

The photographing state determination unit 1 h determines aphotographing state, e.g., a posture of a user at the time ofphotographing based on outputs from the position sensor 3, theacceleration sensor 9 a, the geomagnetic sensor 9 b, and the atmosphericpressure sensor 9 c. The distance determination unit 1 i determines adistance from the digital camera 10 to a subject based on, e.g., a focalposition of the lens 2 a. The display control unit 1 j controls thedisplay unit 8 and displays an image obtained by the imaging unit 2,image feature data or a display representing its similarity (e.g., adisplay 89 in FIG. 1C), a guide display at the time of photographing,and others. The clock 1 k outputs a time required for recording aphotographing time or the like in association with an image.

An outline of an operation of the digital camera 10 according to thisembodiment will now be described with reference to FIG. 2A to FIG. 2D.In this embodiment, as shown in FIG. 2A, the digital camera 10 ispointed at an arbitrary subject 91 by a user to carry out photographing.At this time, an image acquired by the imaging unit 2 is displayed inthe display unit 8 as a through image 81. The signal processing controlunit 1 of the digital camera 10 determines a theme of the image acquiredby the imaging unit 2 and transmits this theme to the server 50 throughthe transmission/reception unit 5.

The server 50 selects a picture that matches the theme of the imagereceived from the digital camera 10. For example, as shown in FIG. 2A,the server 50 transmits a selected picture to the digital camera 10. Thedigital camera 10 that has received the picture from the server 50displays a tab 82 which is part of the picture in an end portion of thedisplay unit 8. As a position at which this tab 82 is displayed, it ispreferable to adopt a position of a thumb of a right hand of the userwho holds the digital camera 10 having the release button 6 a of theoperation unit 6 on which an index finger of the right hand is placed.

As shown in FIG. 2B, when the user slides his/her finger on the touchpanel 7 to draw out the tab 82 toward the central side of the displayunit 8, the digital camera 10 sequentially displays thumbnail images 83of pictures received from the server 50 in the display unit 8. When theuser selects one of these thumbnail images 83, the digital cameras 10aligns and displays the through image 81 of the image acquired by theimaging unit 2 and a sample image 84 selected by the user in the displayunit 8 as shown in FIG. 2C. When the user further makes a request, thedigital camera 10 performs comparative display. In the comparativedisplay, for example, as shown in FIG. 2C, corresponding positions ofthe through image 81 and the sample image 84 are connected with eachother through, e.g., a line. The comparative display is not restrictedthereto, and it is possible to adopt various kinds of displays as longas they show the through image 81 and the sample image 84 by comparison.

Further, when a user makes a request, the digital camera 10 performs aguide display as shown in, e.g., FIG. 2D. In the guide display, toobtain such an image like the sample image 84, a guide image 85 showinga how to perform photographing is displayed in the display unit 8. Thisguide image 85 comprehensively shows what posture and what directionshould be taken with respect to a subject in order to performphotographing as an image. In the present invention, showing acomprehensible advice display is one theme. Based on such a display, aphotographer can perform the same photographing as a sample that shouldbe photographed immediately.

An example of processing in this embodiment will now be described withreference to flowcharts shown in FIG. 3A and FIG. 3B. At step S101, thesignal processing control unit 1 determines whether a photographing modeis currently set. In the case of the photographing mode, the signalprocessing control unit 1 starts a photographing operation at step S102.That is, the signal processing control unit 1 starts to acquire an imagesignal from the imaging unit 2. Further, when the photographingoperation is started, a sampling rate of atmospheric pressuredetermination is raised, thereby improving an accuracy of heightinformation to be acquired. At step S103, the signal processing controlunit 1 displays a through image in the display unit 8. That is, thesignal processing control unit 1 sequentially displays images acquiredfrom the imaging unit 2 in the display unit 8.

At step S104, the signal processing control unit 1 executes themedetermination processing. This theme determination processing isprocessing of determining a theme of a through image acquired by theimaging unit 2 and displayed in the display unit 8. An example of thetheme determination processing will be described with reference to aflowchart shown in FIG. 4. It is needless to say that situationalanalysis improves when the theme is more finely detailed, and a sampleimage that should be used as a reference can be accurately determined.For example, in the case of photographing a picture of a baby, even if aportrait picture of a woman is presented as a sample, it may not serveas a useful reference. Thus, the theme determination processing isconfigured to enable determining a subject or a photographing scene thatis frequently photographed.

At step S201, the signal processing control unit 1 determines whether aface is included in an image. If it was determined that the face wasincluded, the signal processing control unit 1 determines whether theface is solely present in a central portion of the image at step S202.If it was determined that the face was solely present in the centralportion in the image in this determination, the signal processingcontrol unit 1 determines whether the face is a baby's face at stepS203. If the face was determined to be a baby's face, the signalprocessing control unit 1 determines that the theme of the image is a“baby” at step S204. Then, the theme determination processing isterminated, and the processing returns to step S104.

If the face was not determined to be a baby's face in the determinationof step S203, the processing advances to step S205. At step S205, thesignal processing control unit 1 determines whether the face included inthe image is a child's face. If the face was determined to be a child'sface, the signal processing control unit 1 determines the theme of theimage is a “child” at step S206. Thereafter, the theme determinationprocessing is terminated, and the processing returns to step S104. Ifthe face was not determined to be a child's face in the determination ofstep S205, the processing advances to step S207. At step S207, thesignal processing control unit 1 determines whether the face included inthe image is a woman's face. If the face was determined to be a woman'sface, the signal processing control unit 1 determines that the theme ofthe image is a “woman” at step S208. Then, the theme determinationprocessing is terminated, and the processing returns to step S104. Ifthe face was not determined to be a woman's face in the determination ofstep S207, the processing advances to step S209. At step S209, thesignal processing control unit 1 determines that the theme of the imageis a “regular person's portrait”. Thereafter, the theme determinationprocessing is terminated, and the processing returns to step S104.

If the face was not determined to be solely present in the centralportion of the image at step S202, the processing advances to step S211.At step S211, the signal processing control unit 1 determines whetherthe face corresponds to faces of a pair of a man and a woman. If theface was determined to be faces of a pair of a man and a woman, thesignal processing control unit 1 determines whether wedding clothes areincluded in the image at step S212. If the wedding clothes weredetermined to be included, the signal processing control unit 1determines that the theme of the image is a “wedding” at step S213.Subsequently, the theme determination processing is terminated, and theprocessing returns to step S104. If the wedding clothes were notdetermined to be included in the determination of step S212, theprocessing advances to step S214. At step S214, the signal processingcontrol unit 1 determines that the theme of the image is a “couple”.Then, the theme determination processing is terminated, and theprocessing returns to step S104. If it the face was not determined to befaces of a pair of a man and a woman in the determination of step S211,the processing advances to step S215. At step S215, the signalprocessing control unit 1 determines that the theme of the image is a“regular group of persons”. Subsequently, the theme determinationprocessing is terminated, and the processing returns to step S104.

A wedding ceremony or the like is a very popular photographic scene thatgeneral users have many opportunities to photograph. Therefore, thewedding ceremony or the like should be accurately determined. At thistime, since a custom or a costume differs depending on each country orregion, ingenuity may be exercised so that classification can be carriedout in accordance with each region. Further, as an example similar tothe wedding ceremony, there is an athletic meet or a culture festival,but a description thereof is omitted here. Classification may be carriedout based on not only distances or images but also seasons or eventsfrom regional information or clock information using ambient sound orGPS information.

If the face was not determined to be included in the determination ofstep S201, the processing advances to step S221. The signal processingcontrol unit 1 determines whether a subject is distant at step S221. Ifthe subject was determined to be distant, the signal processing controlunit 1 determines that the theme of the image is a “landscape of a placeor a season” at step S222. Subsequently, the theme determinationprocessing is terminated, and the processing returns to step S104. Ifthe subject was not determined to be distant in the determination ofstep S221, the processing advances to step S223. At step S223, thesignal processing control unit 1 determines that the theme of the imageis a “landscape of animals and plants” at step S223. Then, the themedetermination processing is terminated, and the processing returns tostep S104.

Here, to simplify the description, broad categories are explained here,but the present invention is not restricted thereto. It is needless tosay that, as the “landscape of animals and plants” determined at stepS223, images should be further finely classified so that whether macrophotography is adopted, an angle that provides the best appearance when,e.g., a plant or an insect is a subject, an action when an animal or thelike is a subject, and other aspects can be presented to a user. As tothe “landscape of a place or a season”, there are various popular themessuch as a picture of trains or a picture of stars. It is also needlessto say that these themes should be finely classified.

Depending on the image theme, it can be difficult for general users toperform photography. For example, a landscape of sunrise or sunset or alandscape of reflection of sunlight on a surface of water requires ahighly advanced camera technique. For example, to appropriatelyphotograph reflection on a surface of water, a position of a camera isimportant. In such a case, a value of information of a photographingposture is very high. Furthermore, in macro photography or photographyof a pet, to appropriately face a subject, information of a posture isvery important. To appropriately present a photographing posture havinga high value as described above, adequately selecting a theme of animage is important.

Each theme described with reference to FIG. 4 is just an example, andany other theme may be set as a matter of course. The themedetermination method described above is just an example, and the presentinvention is not restricted thereto; any method that can determine atheme can be used. Besides sounds, positions, and times described above,various image dictionaries may be prepared. Features of images such as acolor or shading may be used. Types of flowers or insects may bedesignated. Moreover, map information may be used and, for example, whena position is along a railway, a picture may be classified as a pictureof trains. When a position is a wedding center, a picture may beclassified as a wedding. When a position is a concert hall, a picturemay be classified as a concert. When a position is a school, a picturemay be classified as a school event. A user may be allowed to input atheme by inputting a sound, selecting an icon, or inputting a characteras a matter of course. Although the example of determining a theme afterholding a camera has been described here, a sample that a user mightwant to see may be set to some extent before photographing, e.g., on theway to an event site by train. In the case of a wedding ceremony or thelike, the content of an event can be predicted and prepared beforearriving at a hall, and hence retrieving a sample image may be enabledbeforehand.

Again referring to FIG. 3A, the description will continue. At step S105,the signal processing control unit 1 determines whether a themedetermined by the theme determination processing has changed. If thetheme has changed, the signal processing control unit 1 terminates theguide display that is being displayed at step S106. Then, the processingadvances to step S112. If the theme was not determined to have changedat step S105, the processing advances to step S107.

At step S107, the signal processing control unit 1 determines whetherthe guide display is yet to start. If the guide display was notdetermined to be yet to start, i.e., if the guide display was determinedto have already started, the processing advances to step S111. If theguide display was determined to be yet to start at step S107, theprocessing advances to step S108. At step S108, the signal processingcontrol unit 1 transmits the theme determined by the theme determinationprocessing to the server 50 and acquires a sample image group concerningthis theme. At step S109, the signal processing control unit 1 displaysthe tab 82 in the display unit 8 as shown in FIG. 2A by using the sampleimage acquired from the server 50.

At step S110, the signal processing control unit 1 determines whetherthe touch panel 7 on the tab 82 displayed in the display unit 8 was slidtoward the central direction of the touch panel 7. If the touch panel 7was not determined to have been slid, the processing advances to stepS112. If it was determined to have been slid at step S110, theprocessing advances to step S111.

At step S111, the signal processing control unit 1 executes guidedisplay processing. This guide display processing is processing forperforming, e.g., such guide processing as shown in FIG. 2C and FIG. 2D.An example of the guide display processing will now be explained withreference to a flowchart shown in FIG. 5. At step S301, the signalprocessing control unit 1 determines whether a user selected acomparison mode. If the comparison mode was not determined to have beenselected, the signal processing control unit 1 determines whether thetouch panel 7 was touched and an image was selected at step S302.

If the touch panel 7 was determined to have not been touched, the signalprocessing control unit 1 sequentially displays thumbnail images ofsample images at step S303. That is, the thumbnail images aresequentially displayed in the display unit 8 as if they flow in adirection along which a user slid at step S110. At step S304, the signalprocessing control unit 1 determines whether all thumbnail images weredisplayed. If all the thumbnail images were determined to have not beendisplayed, the guide display processing is terminated, and theprocessing returns to step S111 described with reference to FIG. 3A.

If all the thumbnail images were determined to have been displayed atstep S304, the processing advances to step S305. At step S305, thesignal processing control unit 1 determines whether communication withthe server 50 is possible. If the communication was determined to bepossible, the signal processing control unit 1 further acquires sampleimages from the server 50 at step S306. Then, the guide displayprocessing is terminated, and the processing returns to step S111. Ifthe communication was determined to be impossible at step S305, theprocessing advances to step S307. At step S307, the signal processingcontrol unit 1 repeats the display from a first thumbnail image. Then,the guide display processing is terminated, and the processing returnsto step S111.

If the touch panel 7 was determined to have been touched at step S302,the signal processing control unit 1 displays a touched sample image inthe display unit 8 at step S308. At step S309, the signal processingcontrol unit 1 determines whether the comparison mode was selected. Ifthe comparison mode was determined to have been selected, the signalprocessing control unit 1 sets a flag for setting the comparison mode tothe comparison mode at step S310. Subsequently, the guide displayprocessing is terminated, and the processing returns to step S111. Ifthe comparison mode was determined to have not been selected at stepS309, the guide display processing is terminated, and the processingreturns to step S111.

If the comparison mode was determined to have been selected at stepS301, the processing advances to step S311. At step S311, the signalprocessing control unit 1 determines whether the current mode is a guidedisplay mode. If the current mode is not the guide display mode, thesignal processing control unit 1 performs a comparative display in thedisplay unit 8 at step S312. In the comparative display, for example, asshown in FIG. 2C, a through image that is being acquired and a sampleimage are aligned and displayed. Further, corresponding portions ofthese images, e.g., edges of faces are connected through a line anddisplayed. Furthermore, for example, a direction of a face may bedisplayed. Moreover, a rotating direction may be indicated by an arrow.Based on such a display, the user can readily understand a differencebetween the through image and the sample image. Besides such a displayexample, a difference may be displayed by using, e.g., a moving image,morphing, showing illustrations, or avatars, as long as relevance can bevisually confirmed.

Subsequently, at step S313, the signal processing control unit 1determines whether the guide display mode has been requested. If theguide display mode has not been requested, the guide display processingis terminated, and the processing returns to step S111. If the guidedisplay mode has been selected at step S313, the processing advances tostep S314. At step S314, the signal processing control unit 1 sets aflag for setting the guide display mode to the guide display mode. Then,the guide display processing is terminated, and the processing returnsto step S111.

When it is determined that current mode is the guide display mode atstep S311, the processing advances to step S315. At step S315, thesignal processing control unit 1 displays a photographing method whenthe selected sample image was acquired in the display unit 8 by using,e.g., drawings.

As the guide display, for example, such images as shown in FIG. 6A toFIG. 6I are displayed. For example, drawings that show a photographerholding the camera near his/her face while standing, like in FIG. 6A,FIG. 6B, and FIG. 6C, a photographer holding the camera while kneeling,like in FIG. 6D, FIG. 6E, and FIG. 6F, or a photographer holding thecamera raised up, like in FIG. 6G, FIG. 6H, and FIG. 6I. Further, forexample, drawings show that the photographer held the camerahorizontally, like in FIG. 6A, FIG. 6D, and FIG. 6G, the photographerheld the camera in a direction looking down, like in FIG. 6B, FIG. 6E,and FIG. 6H, or that the photographer held the camera in a directionlooking up, like in FIG. 6C, FIG. 6F, and FIG. 6I.

Further, the signal processing control unit 1 can display figuresrepresenting information that the photographer took a picture whilelying on his/her belly, that the photographer took a picture whilepanning the camera, or that the photographer held the camera in avertical position or a horizontal position in the display unit 8.Moreover, for example, as shown in FIG. 2D, an image showing a postureof the photographer may be combined with a through image including asubject and displayed. As described above, for example, a position ofthe camera with respect to the photographer is shown by each display,and the user can easily understand the photographing method for sampleimages.

In the case of photographing Mt. Fuji reflected on the surface of water,photographing while lying on one's belly is recommended, but even thoughgeneral users may not be aware of such an unnatural posture, they willbe able to perform photography like professionals in no time. However,according to the posture graphic display of the photographing method orthe body position display at the time of photographing, techniques canbe easily presented to users.

Furthermore, when the difficulty level information of the various kindsof postures is additionally provided to the sample images, effort is notwasted on determining that a given posture, state, or tool to be usedcannot be adopted. For example, there is a case that photographing whilelying on one's belly is impossible, depending on clothes thephotographer is wearing. Moreover, photographing using a tool isdifficult if the photographer does not have the tool, and photographingwhile stretching out has a high difficulty level, depending on thephotographer's height. As described above, it is important to convert adifficulty level into a numerical value in accordance with each postureand associate and record the converted value. For example, a difficultylevel is low when the camera is held near the photographer's face whilethe photographer is standing, like in FIG. 6A, FIG. 6B, and FIG. 6C (forexample, the difficulty level is set to 1), and the difficulty levelincreases depending on what the photographer is wearing when the camerais held while the photographer is kneeling, like in FIG. 6D, FIG. 6E,and FIG. 6F, and hence the difficulty level may be set to 2.Additionally, imitating, e.g., a photographer who is holding the cameraraised, like in FIG. 6G, FIG. 6H, and FIG. 6I is difficult, depending onone's height or clothes, and the difficulty level is set to 3 in thiscase, and the difficulty level is set to 4 in the case of lying on one'sbelly, and the difficulty level is set to, e.g., 5 in the case of usinga tool. The difficulty level may be set to 3 when the tool is easilyavailable as a matter of course. It is to be noted that FIG. 6A to FIG.6I show drawings to aid the description, and these drawings may beformed into icons as avatar information as they are so that they canfunction as posture information (guide information). Each of such iconsmay be added to each acquired image.

Further, at step S316, the signal processing control unit 1 displays adifference between the current photographing method and the sample imagephotographing method in the form of characters. For example, when a useris currently holding the camera while standing whereas a selected sampleimage is acquired while the photographer is kneeling, for example,“photographing was performed while squatting down” is displayed.Furthermore, the sample image photographing method may be presented to auser by using sounds. Subsequently, the guide display processing isterminated, and the processing returns to step S111.

A description will now be given as to a method of recognizing a currentphotographing posture of a user by the digital camera 10. It is needlessto say that a body position in which photographing was performed may bemanually selected from a list of photographing body positions, butautomatically recording each body position is very convenient in thecase of taking many pictures. As described above, the accelerationsensor 9 a, the geomagnetic sensor 9 b, and the atmospheric pressuresensor 9 c are provided to the digital camera 10. The photographingstate determination unit 1 h of the signal processing control unit 1acquires how a user holds the digital camera 10, a posture of thedigital camera 10, and other items based on outputs from these sensors.For example, an inclination of the digital camera 10 relative to ahorizontal plane can be acquired by calculating the direction of gravityby the photographing state determination unit 1 h based on an outputfrom the acceleration sensor 9 a. For example, rotation of the digitalcamera 10 on the horizontal plane can be acquired by calculating adirection relative to terrestrial magnetism by the photographing statedetermination unit 1 h based on an output from the geomagnetic sensor 9b. For example, a vertical height of the digital camera 10 can beacquired based on an output from the atmospheric pressure sensor 9 c.

A method of calculating a vertical height of the digital camera 10 usingthe atmospheric pressure sensor 9 c will now be further described withreference to FIG. 7. The atmospheric pressure sensor 9 c outputs a valueindicative of an atmospheric pressure. The photographing statedetermination unit 1 h acquires this atmospheric pressure and calculatesa change in vertical height from a change in this atmospheric pressure.In FIG. 7, outputs from the atmospheric pressure sensor 9 c areschematically shown on a lower side, and a relationship between aposture of a user 70 and a position of the digital camera 10 at eachmoment is schematically shown on an upper side.

For example, when the user 70 carries the digital camera 10 withhim/her, the digital camera 10 is generally present at a position lowerthan a face of the user 70. Furthermore, when the user 70 carries thedigital camera 10 with him/her, the digital camera 10 vibrates up anddown in accordance with footsteps of the user 70. Thus, when outputsfrom the atmospheric pressure sensor 9 c periodically fluctuate up anddown like a period (a) shown in FIG. 7, the photographing statedetermination unit 1 h determines that the user 70 is walking. It is tobe noted that the vibration when the user 70 is walking may be acquiredby using outputs from the acceleration sensor 9 a in place of outputsfrom the atmospheric pressure sensor 9 c. Moreover, the vibration whenthe user 70 is walking may be detected by using both the atmosphericpressure sensor 9 c and the acceleration sensor 9 a. The photographingstate determination unit 1 h sets an output from the atmosphericpressure sensor when the user 70 was determined to be walking as areference atmospheric pressure at a position lower than the face.

When the user 70 turns on a power supply or performs an operation in thedigital camera 10, the user 70 generally moves the digital camera 10 tobe closer to his/her face to confirm an operating portion like a period(b) shown in FIG. 7. At this time, since the digital camera 10 israised, an output from the atmospheric pressure sensor 9 c is decreased.A relationship between the precedently acquired reference atmosphericpressure and a height of the face is calibrated based on a change inoutput from the atmospheric pressure sensor 9 c.

Then, when the user 70 performs photographing like a period (c) shown inFIG. 7, the vibration of the camera stops. The photographing statedetermination unit 1 h acquires this stop of the vibration based onoutputs from the atmospheric pressure sensor 9 c or the accelerationsensor 9 a. The photographing state determination unit 1 h compares anoutput from the atmospheric pressure sensor 9 c at this moment with thecalibrated reference atmospheric pressure and estimates a posture of theuser 70 at the time of photographing with respect to a posture of theuser 70 at the time of walking. In the example shown in FIG. 7, outputsfrom the atmospheric pressure sensor 9 c are higher than the referenceatmospheric pressure. Based on this state, the photographing statedetermination unit 1 h estimates that the user 70 is photographing whilesquatting down.

After the photographing, the digital camera 10 is moved closer to theface when the digital camera 10 is operated like a period (d) shown inFIG. 7. When the user 70 again starts to walk like a period (e) shown inFIG. 7, outputs from the atmospheric pressure sensor 9 c or outputs fromthe acceleration sensor again fluctuate. At this time, the digitalcamera 10 is considered to be provided at a position lower than the faceof the user 70. As described above, the photographing statedetermination unit 1 h estimates a posture of the user based on arelationship between a series of movements of the digital camera 10 anda change in output from the atmospheric pressure sensor 9 c at thismoment.

Additionally, when a distance to a subject acquired in an autofocus (AF)operation is also used besides outputs from the acceleration sensor 9 a,the geomagnetic sensor 9 b, and the atmospheric pressure sensor 9 c,parameters concerning such photographing states as shown in FIG. 8A andFIG. 8B can be obtained. That is, the photographing state determinationunit 1 h can obtain a height H1 and an inclination angle θ1 of thedigital camera 10 and a distance D1 from the digital camera 10 to asubject in the case of photographing in a standing position whilelooking down on the subject as shown in FIG. 8A. Further, thephotographing state determination unit 1 h can obtain a height H2 and aninclination angle θ2 of the digital camera 10 and a distance D2 from thedigital camera 10 to a subject in the case of photographing in asquatting position as shown in FIG. 8B. The signal processing controlunit 1 can use, e.g., figures like FIG. 8A and FIG. 8B in the guidedisplay. When such figures are used for the guide display, the user canreadily understand a positional relationship between the subject and thedigital camera 10.

Here, although the example where a body position and a posture areautomatically detected has been described, this detection may besemi-automatically carried out as a matter of course, and a differencefrom a photographing posture designated by a photographer at thebeginning may be determined by various sensors. For example, anatmospheric pressure or an acceleration may be used to determine fromthe difference that the posture has been changed. Alternatively, sincemany pictures may be taken in the same posture in some situations, afirst designated body position can be used as photographing posture dataas it is. In particular, as there are cases in which photographing iscarried out using various tools such as a tripod, use of tools may berecorded rather than performing automatic determination in such a case.Input via sounds or touch may be used for the designation.

Again referring to FIG. 3A, the description will be continued. At stepS112, the signal processing control unit 1 determines whether therelease button was pressed to input a photographing operation. If thephotographing operation was determined to have not been input, theprocessing returns to step S101. On the other hand, if the photographingoperation was determined to have been input at step S112, the processingadvances to step S113. At step S113, the signal processing control unit1 allows the imaging unit 2 to perform an imaging operation. The imagingunit 2 converts a subject image into an electrical signal and creates animage signal.

As photographing posture data, such pictograms as shown in FIG. 6A toFIG. 6I for the explanation may be formed and used as icons thatrepresent avatar information. These icons may be used so that aphotographer can intuitively recognize a posture at the time ofphotographing. That is, icons may be combined and displayed as guideinformation or help display at the time of image reproduction orreproduction.

For example, when a photographer holds the camera near his/her face in astanding state like FIG. 6A, FIG. 6B, and FIG. 6C, there is generated anicon in which a circular portion representing a face is arranged on avertically long figure representing an upright body as an image of aphotographing posture and the camera is arranged in front of thecircular portion. Furthermore, when the photographer holds the camerawhile squatting down, like in FIG. 6D, FIG. 6E, and FIG. 6F, there isproduced an icon in which the circular portion representing the face isarranged on a triangular figure representing a squatting body and thecamera is arranged in front of the circular portion. Moreover, in thecase of such a photographing posture as shown in FIG. 6G, FIG. 6H, andFIG. 6I, there is generated an icon in which the circular portionrepresenting the face is arranged on the vertically long figurerepresenting the upright body and the camera is arranged at a positionthat is obliquely above the circular portion. When a posture in whichthe photographer is lying on his/her belly is adopted, there is createdan icon in which the circular portion representing the face is arrangedin front of a horizontally long figure representing a body lying onhis/her belly and the camera is arranged in front of the circularportion.

The photographing posture data may be provided by recording an imagecreated in a simplified manner as described above or by recordinginformation that enables forming such an image. A direction along whichthe camera is sighted may be indicated by an arrow, as shown in FIG. 6Ato FIG. 6I.

According to an image file having such an icon display added thereto, aviewer can be aware of a situation where photographing was performed.Therefore, a level of appreciation may also increase for those who didnot take the picture. For example, when there is information such as“photographing while lying on his/her belly”, it can be understood thatthis picture is an image acquired with difficulty, and the true valuecan increase. Therefore, an image having such posture data is alsoeffective in a display apparatus that displays such an image.

Data that is recorded in an image file does not necessarily have to bean icon, and it may be a text, character information, or encodedinformation that represents a photographing posture. The displayapparatus that displays a photographing image having posture informationobtained at the time of photographing reads an auxiliary display that isdisplayed in the form of characters or an icon representing the postureinformation recorded together with the photographing image, combines theread information with the photographing image, and displays a combinedimage.

At step S114, the signal processing control unit 1 acquires informationconcerning a photographing posture of a user as described above. Thesignal processing control unit 1 combines image data obtained by theimaging operation, photographing posture data, and any other data tocreate such an image file 100 as shown in FIG. 9. That is, the imagefile 100 includes image data 101 that is data concerning an imageobtained by the imaging unit 2, camera data 102 which is informationconcerning the digital camera 10, theme classification data 103concerning theme classification obtained by the theme determinationprocessing at step S104, date/place data 104 including information of aphotographing date obtained by the clock 1 g and information of aphotographing place obtained by the position sensor 3, feature data 105which includes feature data, colors, and a position, a size, an angle, agender, and an age of a face as well as other aspects included in animage, photographing control data 106 of a shutter speed, an aperture,and other aspects, subject distance data 107 obtained based on a focallength, subject size data 108 representing a size of a subject occupyingan image, and photographing posture data 109 including an inclination109 a of the camera and a height 109 b of the camera. It is needless tosay that the photographing posture data 109 may be iconic informationlike an avatar. Regardless of the format, it is preferable for cameramanufacturers, mobile device manufacturers, and organizations thatprovide cloud services or photograph services to use these rules incommon. It is to be noted that the image file including a photographingposture and other aspects can be created by the digital camera 10 asdescribed above, but the digital camera 10 may also transmit necessaryinformation to the server 50 so that the image file can be created inthe server 50.

At step S115, the signal processing control unit 1 determines whetherthe image file is to be transmitted to the server 50. For example, it isassumed that transmission is effected when a transmission command isinput from a user. If transmission is determined, the signal processingcontrol unit 1 transmits the image file to the server 50 at step S116.If the transmission is determined to be not effected in thedetermination of step S115, the processing returns to step S101.

If the photographing mode was not determined at step S101, theprocessing advances to step S121. At step S121, the signal processingcontrol unit 1 determines whether the current mode is a reproductionmode. If the reproduction mode was determined, the signal processingcontrol unit 1 displays a list of images recorded in the recording unit4 in the display unit 8 at step S122. At step S123, the signalprocessing control unit 1 determines whether enlarged reproduction wasselected. If the enlarged reproduction was not selected, the processingreturns to step S121. If the enlarged reproduction was determined tohave been selected at step S123, the processing advance to step S124. Atstep S124, the signal processing control unit 1 enlarges and displays aselected image in the display unit 8. At step S125, the signalprocessing control unit 1 determines whether the selected image is to betransmitted to the server 50. If the selection was determined, thesignal processing control unit 1 transmits an image file to the server50 at step S126. Then, the processing advances to step S127. If thetransmission was not determined at step S125, the processing advances tostep S127. At step S127, whether the processing returns to the menu isdetermined at step S127. If the return was determined, the processingreturns to step S121. If the return was not determined at step S127, theprocessing returns to step S124, and the enlarged display of eachselected image is continued.

If the reproduction mode was not determined at step S121, the processingadvances to step S131. At step S131, whether a notification such asinformation concerning a popular image is to be acquired from the server50 is determined. If the acquisition of the notification was notdetermined, the processing advances to step S132. At step S132, thesignal processing control unit 1 determines whether the processing is tobe terminated. If the termination was determined, the processing isterminated. If the termination was not determined at step S132, theprocessing returns to step S101.

If the acquisition of the notification was determined at step S131, theprocessing advances to step S133. At step S133, the signal processingcontrol unit 1 communicates with the server 50 and acquires thenotification, e.g., the information concerning a popular image. Thesignal processing control unit 1 displays the acquired informationincluding an image in the display unit 8. At step S134, the signalprocessing control unit 1 determines whether an evaluation value or thelike provided by a user relative to the displayed notification is to betransmitted. If the transmission was determined, the signal processingcontrol unit 1 transmits the evaluation value or the like provided bythe user at step S135. Then, the processing advances to step S136. Atstep S134, if no transmission was determined, the processing advances tostep S136. At step S136, the signal processing control unit 1 determineswhether the processing returns to the menu. If the return wasdetermined, the processing returns to step S101. If no return wasdetermined at step S136, the processing returns to step S133, and thesignal processing control unit 1 continues the display of thenotification.

FIG. 10 shows a schematic view of a relationship among the server 50,the digital camera 10, and other aspects according to this embodiment.Many digital cameras 10 are connected to the server 50. In FIG. 10, adigital camera 10-1, a digital camera 10-2, and a digital camera 10-3are connected. Further, a general PC 61, a smartphone 62, or otherdevices are also connected to the server 50.

A transmission/reception unit 51 configured to communicate withterminals, e.g., the digital camera 10, the PC 61, the smartphone 62, orother device is provided in the server 50. Furthermore, a recording unit52 that records images received from the digital cameras 10 or otherdevice is provided in the server 50. The recording unit 52 records animage file including such information as shown in FIG. 9. That is, therecording unit 52 includes photographing status information 52 aincluding photographing posture data, subject distance data, date/placedata, and other data. Furthermore, in the server 50 are provided afeature extraction unit 53 that extracts features of each image recordedin the recording unit 52 and a totalization unit 54 that totalizes datasuch as votes from respective users.

Each digital camera 10 transmits an image file of each acquired image tothe server 50. For example, in the case shown in FIG. 10, the digitalcamera 10-2 transmits an image A and an image B to the server 50, andthe digital camera 10-3 transmits an image C to the server 50. Theserver 50 receives the image files and records them in the recordingunit 52. The image files are transmitted to the server 50 from not onlythe digital cameras 10 but also the PC 61, the smartphone 62, or otherdevice. In addition, there are cases that the photographing posture datais not included in files other than image files created by the digitalcameras 10.

The feature extraction unit 53 in the server 50 classifies the imagefiles in accordance with information of themes determined by the digitalcameras 10 and included in the image files. Moreover, the featureextraction unit 53 may extract features of images, determine themesbased on results, and perform classification in accordance with thethemes. The server 50 transmits the image files to the digital cameras10, the PC 61, and other devices based on requests from the digitalcameras 10, the PC 61, and other devices. The images received by thedigital cameras 10, the PC 61, and other devices are viewed by users.For example, in FIG. 10, a user 70 takes a picture of a cat 92 that isthe subject. When the digital camera 10-1 requests an image similar toan image that is currently acquired from the server 50, a sample imagesimilar to the cat 92 is transmitted from the server 50 to the digitalcamera 10-1. Additionally, the server 50 transmits photographing posturedata and the like when the transmitted image was acquired in response toa request from, e.g., each digital camera 10.

The user can evaluate the viewed image by voting or the like of a viewedimage. That is, the user can transmit whether he/she likes a viewedimage, give a point to the image, provide a comment, and such like viathe server 50. The totalization unit 54 of the server 50 totalizesresults of votes from the users and records a result in association witheach image file recorded in the recording unit 52. For example, when thedigital camera 10 requests for data of a popular image, the server 50transmits an image that is recorded in the recording unit 52 anddetermined to be popular to this digital camera 10 or the like.Furthermore, the server 50 transmits, e.g., a result of totalizingpopularity information to each digital camera 10, the PC 61, thesmartphone 62, and other devices. This result may be a graph that showsa popularity of each image as shown in, e.g., FIG. 11. Moreover,popularity may be totalized in accordance with, e.g., each theme. Forexample, information showing that a picture of a baby is popular or thata picture of a baby and a mother is popular may be totalized.

The guide display processing of the digital camera 10 according to thisembodiment explained with reference to FIG. 5 or processing of theserver 50 in the transmission/reception of image data or the popularityvoting explained with reference to FIG. 10 will now be described withreference to FIG. 12. At step S401, the server 50 determines whether atheme was successfully acquired from the digital camera 10. If the themewas successfully acquired, the server 50 transmits an image concerningthe acquired theme to the digital camera 10 at step S402. At step S403,the server 50 determines whether a request for an image from the digitalcamera 10 was terminated. If the request for an image was notterminated, the processing returns to step S402, and transmission of arelated image to the digital camera 10 is continued. If the request foran image was determined to have been terminated at step S403, theprocessing advances to step S404. At step S404, the server 50 terminatesthe transmission of a related image, and the processing returns to stepS401.

If the theme was determined to have not been acquired at step S401, theprocessing advances to step S411. At step S411, the server 50 determineswhether the digital camera 10 is performing the comparative display. Ifthe comparative display was determined, the server 50 transmits positiondata of each position in the image transmitted to the digital camera 10at step S412. For example, when an image including a face is transmittedas sample data, information concerning a profile of this face orinformation of positions of eyes, a nose, a mouth, and other parts istransmitted to the digital camera 10. Then, the processing returns tostep S401.

If the comparative display was determined to have not been performed atstep S411, the processing advances to step S421. At step S421, theserver 50 determines whether the digital camera 10 is performing theguide display. If the guide display was determined to be beingperformed, information concerning a photographing method includingphotographing posture data is transmitted to the digital camera 10 atstep S422.

If the guide display was determined to be not being performed at stepS421, the processing advances to step S431. At step S431, the server 50determines whether an image display is requested. If the image displaywas determined to be requested, the server 50 transmits data of therequested image to, e.g., the digital camera 10, the PC 61, or thesmartphone 62 at step S432. At step S433, the server 50 determineswhether voting concerning popularity voting or the like was carried outin regard to the transmitted image data. If the voting was determined tohave been performed, the server 50 records a voting result in therecording unit 52 in accordance with each image at step S434. Then, theprocessing returns to step S401.

If the image display was determined to have not been requested at stepS431, the processing advances to step S441. At step S441, the server 50receives an image and determines whether recording this image wasrequested. If the recording was not requested, the processing returns tostep S401. If the recording was requested at step S441, the processingadvances to step S442. At step S442, the server 50 records the receivedimage in the recording unit 52. At step S443, the server 50 determineswhether the image file includes the image together with photographingposture data. If the photographing posture data is not included, theprocessing returns to step S401. If the photographing posture data wasdetermined to be included at step S443, the processing advances to stepS444. At step S444, the server 50 records the photographing posture datain the recording unit 52. The server 50 may create an image representinga photographing posture based on the photographing posture data. Thisimage may be recorded in the recording unit 52. Subsequently, theprocessing returns to step S401.

As described above, for example, the imaging unit 2 functions as animaging unit that acquires a subject image which is an image of asubject. For example, the sample acquisition unit 1 b functions as asample acquisition unit that acquires a sample image. For example, theguide display generation unit 1 f functions as a guide displaygeneration unit that creates a guide display showing a photographingmethod to approximate the composition of the subject image to thecomposition of the sample image. For example, the display unit 8functions as a display unit that displays the guide display. Forexample, an image file 100 functions as a sample file including thesample image and position and posture information representing aposition and a posture of the sample imaging unit that acquired thesample image. For example, the photographing state determination unit 1h functions as a feature extraction unit that extracts a subject featureportion as a feature portion of the subject image and a sample featureportion as a feature portion of the sample image. For example, the themedetermination unit 1 d functions as a theme determination unit thatdetermines a theme of the subject image in accordance with the subjectimage.

For example, the photographing state determination unit 1 h functions asa position and posture information calculation unit that calculatesposition and posture information representing a position and a postureof the imaging unit based on a gravity direction and height information.For example, the signal processing unit 1 a functions as an image filecreation unit that creates an image file in which the subject image isassociated with the position and posture information. For example, thedistance determination unit 1 i functions as a distance acquisition unitthat acquires a subject distance as a distance to the subject.

According to this embodiment, the digital camera 10 can notify a userof, e.g., information showing a photographing posture for a sample imageobtained from the server 50 or the like. The digital camera 10 cannotify a user of, e.g., a difference between a sample image and an imagethat is to be acquired by the user through the guide display or thelike. According to such a guide display, the user can easily acquire animage having the same composition as the sample image.

Further, according to this embodiment, the digital camera can acquireinformation concerning a posture taken by the user to performphotographing by using outputs from various kinds of sensors. Therefore,a posture at the time of this photographing can be easily recorded onthe acquired image. Furthermore, the digital camera 10 can notify theuser of a difference between a posture in which the user is about toperform photographing and a posture in which the user took the imageobtained from the server 50.

According to this embodiment, the digital camera 10 can acquire from theserver 50 each image concerning a theme relating to an image that is tobe acquired by the user and display the acquired image. At this time,the digital camera 10 can also display images concerning the theme in apopularity order. When a theme of a through image is determined andimages matching the theme are displayed in the display unit 8 asdescribed above, the user can confirm each image of interest withoutperforming a special operation such as inputting a keyword.

Moreover, for example, since each sample image is acquired from theserver 50 through the Internet, the digital camera 10 can acquire a verylarge number of images. As shown in FIG. 2B, in the digital camera 10,since images that can be candidates for the sample image aresequentially displayed and the user can select one from these images,the user can rapidly and intuitively select his/her favorite image.

When posture difficulty level information is added to a sample image asdescribed above, the user can determine that a displayed posture or bodyposition or a tool to be used cannot be adopted, and effort does nothave to be wasted. For example, there are cases that the user determinesthat photographing while lying on one's belly is impossible depending onthe clothes worn. Additionally, there are cases that the user determinesthat photographing using a tool is difficult since he/she does not havethe tool or determines that a difficulty level is high in photographingwhile stretching out since the user's height is insufficient. Convertinga difficulty level into a numerical value and recording it inassociation with each posture as described above enables exercising aneffect in the determination mentioned above.

Further, the digital camera 10 can record an acquired image in theserver 50 through, e.g., the Internet. As a result, the acquired imagecan be shared by many people, and evaluations or the like of personsother than a photographer can be easily obtained. Since information suchas popularity of an image based on evaluations of other people can beadded to the image, the digital camera 10 can select a more appropriatesample image. For example, functions included in the server 50 shown inFIG. 10 or part of a program that executes the processing shown in FIG.12 may be included in the digital camera. Furthermore, functions in theserver may be dispersed and provided in servers or the user's PC or amobile device.

Second Embodiment

The step S315 and step S316 of the guide display processing in the firstembodiment are different from counterparts in a second embodiment. Inthe first embodiment, the digital camera 10 performs the guide displaybased on photographing posture data obtained when a sample imageincluded in an image file was acquired. On the other hand, in thisembodiment, the digital camera 10 estimates a photographing method basedon an image and performs the guide display.

Estimating a photographing method based on an image will now bedescribed with reference to FIG. 13. For example, when attention is paidto a person's face, a determination can be made based on which side thecenter of eyes, a ridge of a nose, or a mouth tilts toward with respectto the center of the face. For example, when the digital camera 10directly faces the face from the front side, a positional relationshipof respective portions of the face is as shown in FIG. 13(c). Based onthis relationship, for example, when the digital camera 10 is arrangedto face the face from the right side of the face, the respectiveportions of the face tilt toward the left side as shown in FIG. 13(a).For example, when the digital camera 10 is arranged to face the facefrom the left side of the face, the respective portions of the face tilttoward the right side as shown in FIG. 13(e). For example, when thedigital camera 10 is arranged to face the face from the lower side ofthe face, the respective portions of the face tilt toward the upper sideas shown in FIG. 13(b). For example, when the digital camera 10 isarranged to face the face from the upper side of the face, therespective portions of the face tilt toward the lower side as shown inFIG. 13(d).

A method for calculating an angle of the digital camera 10 relative to aface from a positional relationship of respective portions of the facein an image will now be described with reference to FIG. 14A and FIG.14B. First, a method for obtaining an angle of the face in the verticaldirection of the face, i.e., an inclination angle Θy will be described.FIG. 14A is a schematic view showing the face from a lateral side. It isassumed that a distance from the center of the face to a pupil seen fromthe lateral side is Fz. Further, a height of the face seen from thelateral side is assumed to be Fy. The following Expression (1) can bepresumed based on a ratio of a general human body.Fy=3×Fz  (1)Assuming that a height from the center of the face to the pupil is ΔFy,the following Expression (2) can be achieved.ΔFy/Fz=sin Θy  (2)Based on Expressions (1) and (2), the following Expression (3) can beachieved.3×ΔFy/Fy=sin Θy  (3)

Therefore, based on the image obtained from the front side direction,the inclination angle of the face can be calculated from the height Fyof the face and the height ΔFy from the center of the face to the centerof the pupil by using Expression (3).

A description will now be given as to a method for obtaining an angle ofthe face in the horizontal direction, i.e., a rotation angle Θx based onan image. FIG. 14B shows a schematic view when the face is seen from theupper side.

It is assumed that the face has a circular shape with a radius of Ex asseen from the upper side. At this time, a distance from a central lineof the face, e.g., a nose to a pupil is assumed to be ΔFx. At this time,the following Expression (4) can be achieved.ΔFx/Fx=sin Θx  (4)

Therefore, the rotation angle of the face can be calculated from theradius Fx of the face and the distance ΔFx from the center of the faceto the center of the pupil based on the image obtained from the frontside direction by using Expression (4). It is to be noted that theexample targeting the face has been described, but the present inventionis not restricted thereto. A human body or the like may be determined asa target, or a flower or a building may be determined as a target. Basedon features of a subject, a direction of the subject can be estimated.

Since a rotation angle and an inclination angle of, e.g., a face can beobtained based on an image, these angles in a through image that is tobe acquired by a user can be compared with counterparts in a sampleimage selected by the user. The guide display generation unit 1 f cancreate a guide display that shows a photographing direction that enablesacquiring the same image as a sample image based on these angles. Forexample, as shown in FIG. 15, an indication display 86 that shows adirection in which the digital camera 10 should be moved relative to asubject 91 may be superimposed on a current through image 81 whiledisplaying the through image 81. For this indication display (the guidedisplay), information in a database searched for the purpose of thecomparison is exploited. Furthermore, the indication display may beprovided by using a language or a figure in accordance with codes storedin the database. At this time, a selected sample image 84 may be alsodisplayed in the display unit 8. Moreover, for example, based on a sizeof a face in an image, a guide display for, e.g., increasing orshortening a distance from the digital camera 10 to the subject 91 orincreasing or reducing a focusing distance of the lens 2 a may becarried out.

The guide display is determined from a difference between an actualphotographing status (a posture) and a photographing status (a posture)of a sample image. Therefore, information indicative of the differencebetween postures is recorded in the recording unit 4 of the camera orthe recording unit 52 of the server, and the digital camera 10 reads outthis information and performs the guide display. The guide display maydisplay text information like “please stand up” or “please sit down”.The text information may be information showing a posture itself like“stretch up and take a picture”. When a user sees information of aposture, he/she can understand photographing is impossible unless he/shestretches up, and hence such information also functions as a guide. Asthe guide display, for example, in a situation that a user is sitting orstanding, if a sample image has posture information that this image wasacquired by the user while lying on his/her belly, a text such as“please lie down and sight at a lower angle” or “you cannot take apicture unless you are lying in place of standing” may be displayed.That is, a great effect can be exercised when not only the postureinformation is used as it is but also it is used as a difference betweenthe posture information included in a sample image and a currentposture. It is also possible to issue a turn-around instruction bydetecting not only a posture but also a direction of a face, a directionof any other subject, or other direction. Moreover, when the subject isa building or the like, positional information based on azimuthinformation or GPS information may be also used. As the guide display, asize of a subject, a difference in photographing parameter setting atthe time of photographing, or other factor may be reflected. Forexample, a text “please take a picture from 200 m on the west sidetoward the northwest with a focal length of 100 mm and an inclinationangle of 20°” may be displayed. A language that differs depending oneach country or region may be used for text information.

Further, the guide display may be graphic representation using an image,a symbol such as an arrow, or moving picture representation.Furthermore, a warning display or the like may be carried out as theguide display. Moreover, sounds may be used. In the case of creating aguide display showing a moving direction, recorded contents recorded inthe database or the like may be displayed as they are, or the recordedcontents may be graphically represented or translated and displayed.

Additionally, for example, it is assumed that the signal processingcontrol unit 1 determines that a user holds the digital camera 10 asshown in FIG. 6B based on outputs from the acceleration sensor 9 a andthe atmospheric pressure sensor 9 c. Further, at this time, it is alsoassumed that the signal processing control unit 1 determines that a facein a sample image is provided on a front side like FIG. 13(c), but athrough image is as shown in FIG. 13(d), i.e., the digital camera 10takes a picture from a higher position than the sample image. In such acase, the signal processing control unit 1 may display, e.g., such animage as shown in FIG. 6D in the display unit 8 as a guide display.

According to this embodiment, the guide display can be carried out eventhough a sample image does not include photographing postureinformation. The photographing posture information can be added to animage acquired by the digital camera 10.

Modification of Second Embodiment

A modification of the second embodiment will now be described here.Here, a difference between the first embodiment and the secondembodiment will be explained, and like parts will be denoted by likereference signs to omit a description thereof. In the first embodiment,the guide display is created based on photographing posture data or thelike included in an image file of a sample image. Therefore, in thefirst embodiment, a through image is not used for the guide display. Onthe other hand, in the second embodiment, the guide display is createdbased on a comparison between a sample image and a through image. Inthis embodiment, a guide display is created based on photographingposture data or the like included in an image file of a sample image anda comparison between the sample image and a through image.

For example, consideration will be given on a situation where suchphotographing posture data as shown in FIG. 6A is recorded in an imagefile of a sample image and a face in the sample image is provided on afront side as shown in FIG. 13(c). At this time, when a through image isas shown in FIG. 13(d), i.e., when the digital camera 10 takes a picturefrom a higher position than the sample image, the digital camera 10displays such a guide image like FIG. 6D rather than FIG. 6A, forexample. According to this modification, the guide display that isfurther more appropriate than the first embodiment or the secondembodiment can be carried out.

It is to be noted that the foregoing embodiments according to thepresent invention include the following inventions.

(1) An imaging apparatus comprising:

an imaging unit which acquires a subject image as an image of a subject;

an acceleration sensor which detects a gravity direction;

an atmospheric pressure sensor which acquires height information; and

a position and posture information calculation unit which calculatesposition and posture information indicative of a position and a postureof the imaging unit based on the direction of gravity and the heightinformation.

(2) The imaging apparatus according to (1), further comprising an imagefile creation unit which creates an image file in which the subjectimage is associated with the position and posture information.

(3) The imaging apparatus according to (1) or (2), wherein the positionand the posture information calculation unit calculates a holding heightwhich is a height of the imaging apparatus relative to a photographerholding the imaging apparatus based on change in an atmospheric pressurevalue output from the atmospheric pressure sensor in elapsed time.

(4) The imaging apparatus according to (3), wherein the position andposture information calculation unit calculates the holding height basedon the atmospheric pressure value when the atmospheric pressure valueperiodically fluctuates.

(5) The imaging apparatus according to (2), further comprising adistance acquisition unit which acquires a subject distance as adistance to the subject, wherein the image file creation unit createsthe image file in which the subject image and the subject distance isassociated as well.

(6) A display apparatus which displays an acquired image includingposture information obtained at a time of photographing, the apparatuscomprising a display control unit which displays the acquired image andauxiliary information including characters or an image representing theposture information.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

What is claimed is:
 1. A display apparatus for use with an imagingdevice, the display apparatus comprising: a display unit; a guidedisplay generation circuit which acquires an image file including imagedata and photographing posture data including information of aninclination and a height of an imaging apparatus performing an imagingoperation when the image data was created by the imaging operation togenerate a photographing posture guide display based on thephotographing posture data; and a display control circuit which causesthe display unit to display, when the imaging device is in aphotographing mode, an image based on the image data and thephotographing posture guide display, wherein the imaging device includesa reproduction mode, different from the photographing mode, fordisplaying images previously recorded on the imaging device.
 2. Thedisplay apparatus according to claim 1, wherein the photographingposture guide display includes a figure indicative of a photographer anda camera, or a text.
 3. An imaging apparatus comprising: a display unit;a guide display generation circuit which acquires an image fileincluding first image data and first photographing posture dataincluding information of inclination and a height of the imagingapparatus or another imaging apparatus at the time when the first imagedata was created by an imaging operation of the imaging apparatus or theother imaging apparatus to generate a photographing posture guidedisplay based on the first photographing posture data; an imaging unitwhich generates second image data by an imaging operation; and a displaycontrol circuit which causes the display unit to display, when theimaging device is in a photographing mode, an image based on the secondimage data and the photographing posture guide display, wherein theimaging apparatus includes a reproduction mode, different from thephotographing mode, for displaying images previously recorded on theimaging device.
 4. The imaging apparatus according to claim 3, furthercomprising a photographing state determination circuit which acquiressecond photographing posture data including information of aninclination and a height of the imaging apparatus at the time of theimaging operation by the imaging unit, wherein the guide displaygeneration circuit compares the first photographing posture data and thesecond photographing posture data to generate the photographing postureguide display.
 5. The imaging apparatus according to claim 4, whereinthe photographing posture guide display includes a figure indicative ofa photographer and a camera, or a text.
 6. The imaging apparatusaccording to claim 4, further comprising an acceleration sensor and anatmospheric pressure sensor, wherein the photographing statedetermination circuit creates the second photographing posture databased on data acquired by the acceleration sensor and the atmosphericpressure sensor.
 7. A data processing apparatus comprising: an inputwhich acquires image data obtained by an imaging operation of an imagingapparatus; a photographing state determination circuit which acquiresphotographing posture data including information of an inclination and aheight of the imaging apparatus at the time of the imaging operation,wherein the photographing posture data indicates how the imagingapparatus was held by a user when the image data was obtained by theimaging operation; and a signal processing circuit which creates animage file including the image data and the photographing posture data,wherein the photographing posture data indicates whether the user heldthe imaging apparatus (A) over their head, (B) at their eye level whilestanding, (C) at their eye level while kneeling or squatting, or (D) attheir eye level while lying down, when the image data was obtained. 8.The data processing apparatus according to claim 7, wherein thephotographing state determination circuit creates the photographingposture data based on data acquired by an acceleration sensor and anatmospheric pressure sensor, or data input by a sound input or a touchinput.
 9. An imaging apparatus comprising: an imaging unit whichgenerates image data by an imaging operation; a photographing statedetermination circuit which acquires photographing posture dataincluding information of an inclination and a height of the imagingapparatus at the time of the imaging operation, wherein thephotographing posture data indicates how the imaging apparatus was heldby a user when the image data was generated by the imaging operation ofthe imaging unit; and a signal processing circuit which creates an imagefile including the image data and the photographing posture data,wherein the photographing posture data indicates whether the user heldthe imaging apparatus (A) over their head, (B) at their eye level whilestanding, (C) at their eye level while kneeling or squatting, or (D) attheir eye level while lying down, when the image data was generated. 10.The imaging apparatus according to claim 9, further comprising anacceleration sensor and an atmospheric pressure sensor, wherein thephotographing state determination circuit creates the photographingposture data based on data acquired by the acceleration sensor and theatmospheric pressure sensor.
 11. The imaging apparatus according toclaim 9, further comprising a sound input unit or a touch panel, whereinthe photographing state determination circuit creates the photographingposture data based on data input by a sound input using the sound inputunit or a touch input using the touch panel.
 12. The imaging apparatusaccording to claim 9 further comprising: a display unit; and a displaycontrol circuit which causes the display unit to display, when theimaging apparatus is in a photographing mode, a photographing guideusing the photographing posture data.
 13. A file creating methodcomprising: acquiring image data obtained by an imaging operation of animaging apparatus; acquiring photographing posture data includinginformation of an inclination and a height of the imaging apparatus atthe time of the imaging operation, wherein the photographing posturedata indicates how the imaging apparatus was held by a user when theimage data was obtained by the imaging operation of the imagingapparatus; and creating an image file including the image data and thephotographing posture data, wherein the photographing posture dataindicates whether the user held the imaging apparatus (A) over theirhead, (B) at their eye level while standing, (C) at their eye levelwhile kneeling or squatting, or (D) at their eye level while lying down,when the image data was obtained.